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W HILE general articles have de- 
scribed the national education 
assessment project, science teachers 
will be interested not only in the over- 
all plans and progress of the program 
but more particularly with the efforts 
in the field of science education. This 
is a report of progress through the 
summer of 1966. 1 

The assessment project should be 
clearly distinguished from other useful 
educational appraisals that are com- 
monly conducted in American schools. 
Probably the most frequent, type of 
evaluation is to appraise the achieve- 
ment of individual students. This is 
usually done with several purposes in 
mind. It may furnish a further incen- 
tive for students to study, because they 
know they will be tested. It may be 
used as one of the factors in grading 
or promoting students. It provides in- 
formation that can be used by the stu- 
dent and counselor in planning for 
further education, and it often furnishes 
one of the bases for awarding scholar- 
ships. 

A second use of evaluation is to 
diagnose the learning difficulties of an 
individual student or an entire class to 
provide information helpful in planning 
subsequent teaching. A third use of 
evaluation is to appraise the educa- 
tional effectiveness of a curriculum, U 
a course, of instructional materials 
and procedures, and of administrative 
and organizational arrangements. 

Each of these kinds of evaluation is 



RALPH W. TYLER 

Director, Center for Advanced Study in the Behavioral 

Stanford, California 



1 For further background information, views of 
certain individuals, and statements by the Council 
of Chief State School Officers, the ASCD Executive 
Committee, and the AASA, see National Educa - 
. tional Assessment: Pro and Con , published by the 

SCWUCCS National Education Association and the American 

Association of School Administrators. Stock No. 
051-02094. 56 pp. $1. 
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an essential part of the processes of 
teaching or administration. Teachers 
and administrators are using evaluation 
of one sort or another as one of their 
normal procedures. The information 
gained from these appraisals is focused 
upon individual students’ efforts, class 
performance, or the effectiveness of the 
plans, materials, and procedures used 
by the teacher, the school, or the school 
system. 

There is another purpose for evalua- 
tion which is becoming increasingly 
important as. our society becomes more 
complex and anonymous and as edu- 
cation becomes necessary for almost 
everyone in order to participate in the 
common life. In a democracy policies 
and actions depend heavily upon pub- 
lic understanding of the current condi- 
tions and the problems. Increasingly, 
the public in a community or state 
identifies its needs and approves pro- 
posed policies and actions against the 
background of understanding of the 
national and regional situation. Local 
and state policies and programs in the 
field of health, for example, have been 
sharply influenced by the national and 
regional information which is widely 
available regarding the age distribu- 
tion of the population, the incidence of 
illness among different sectors of the 
population, and the availability of 
health services. 

In the field of education, the public 
is often confused about the progress 
being made and the problems encoun- 
tered because we do not have compre- 
hensive data on the educational levels 
of various sectors of our population. 
We have reports on numbers of schools, 
buildings, teachers, and pupils, and 
about the moneys expended, but we 
do not have sound and adequate infor- 
mation on educational results. Be- 
cause dependable data are not avail- 
able, personal views, distorted reports, 
and journalistic impressions are the 
sources of public opinion, and the 
schools are frequently attacked and fre- 
quently defended without the nec- 
essary evidence to support either claim. 
The background of public opinion is 
an important factor in determining the 
moral and financial support given to ed- 
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ucational policies and practices. Sound . f 1 H HE contractor was responsible for 
opinion requires valid data about the X bringing together science teach- 
pr ogress of American education. ers, curriculum specialists, and scien- 

This is the purpose of the assessment fists to formulate statements of the 
project. This type of evaluation is not ‘'''objectives which they believe faithfully 



focused upon individual students, class- 
rooms, schools, or school systems, but 
furnishes overall information about the 
educational attainments of large num- 
bers of people. Initially, the assessment 
will be made of the educational levels 
of four age groups — nine-year-olds, 
thirteen-year-olds, seventeen-year-olds, 
and adults. 

R ecognizing the increasing 
need for public information of 
this sort, Carnegie Corporation of New 
York, a private foundation, in 1964 
appointed an Exploratory Committee 
on Assessing the Progress of Educa- 
tion. I was asked to serve as chairman. 
The committee’s assignment is to con- 
fer with teachers, administrators, school 
board members, and others concerned 
with education to get advice on the 
way in which such a project may be 
constructively helpful to the schools 
and avoid possible injuries. The com- 
mittee is also charged with the devel- 
opment and tryout of instruments and 
procedures for assessing the progress 
of education. In 1966, the Fund for 
the Advancement of Education joined 
in the support of the project. 

The discussions with administrators, 
curriculum specialists, teachers, and 
school board members clearly recom- 
mended that the initial assessment, 
though it could not cover everything, 
should include more than the 3 R’s, 
and as rapidly as possible all the im- 
portant educational tasks of the mod- 
ern school should be covered. In har- 
mony with this suggestion, for the 
initial tryout, instruments are being 
constructed by four leading test devel- 
opment agencies in the fields of reading 
and the language arts, science, mathe- 
matics, social studies, citizenship, fine 
arts and vocational education. In sub- 
sequent years, other important areas 
will be included. Educational Testing 
Service is the contractor responsible 
for the construction of the assessment 
instruments in the field of science. 



reflect the contributions of science to 
the education of students and which 
the schools are seriously seeking to 
attain. It is important for an assess- 
ment that is taken seriously by the 
public to represent authentic science 
and to deal with learning which science 
teachers are earnestly seeking to de- 
velop. This should help to eliminate 
the criticism frequently encountered 
with current tests in which some item 
is attacked by a scientist as being 
“shoddy” science or criticized by school 
people as not in the curriculum. 

The contractor was also required to 
clarify the meaning of each objective 
stated by including with it prototype 
exercises which, in the opinion of the 
science teachers and scientists, give stu- 
dents an opportunity to demonstrate 
the behavior implied by the objectives. 
This requirement was established to 
assure that the statements of objectives 
would not be so vague as to make their 
interpretation a matter of widely di- 
verging opinions. Each objective is 
defined in concrete terms by the exer- 
cises which the science panel included 
as prototypes for the assessment. 

The panel of science teachers, cur- 
riculum specialists, and scientists that 
were assembled by Educational Testing 
Service to formulate and define objec- 
tives of science education included: 2 
J. W. Buchta, executive secretary, 
American Association of Physics 
Teachers 

Robert H. Carleton, executive secre- 
tary, National Science Teachers As- 
sociation 

Judson B. Cross, Physical Science 
Study Committee, Educational Serv- 
ices Incorporated 

Charles E. Erickson, School of Chemis- 
try, Rutgers University 

2 NSTA Executive Secretary’s Note: To our 
knowledge, at least one additional panel comparable 
in divers? y and stature of personnel was similarly 
assembled to serve in an advisory capacity in the 
area of science education during development test 
construction work by another contracting agency. 
Assurance has also been given that advisory and 
consultant assistance will be sought at other times 
as the assessment project moves ahead. — RHC 
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Frederick L. Ferris, Jr., Geology De- 
partment, Princeton University 
R. Buckminster Fuller, Carbondale, 
Illinois 

Glenn W. Giddings, General Electric 
Management Research and Develop- 
ment Institute 

Bernardo F. Grossling, Geological Sur- 
vey, U. S. Department of the Interior 
John H. Marean, science consultant, 
State of Nevada 

L. S. McClung, chairman, Department 
of Bacteriology, Indiana University 
Floyd V. Moneghan, Department of 
Natural Science, Michigan State Uni- 
versity 

E. Duer Reeves, president, Reeves As- 
sociates, Incorporated, Summit, New 
Jersey 

The professional staff from ETS 
were: Frank J. Fornoff, chairman, Sci- 
ence Test Development; Raymond E. 
Thompson, associate examiner; and 
William Kastrinos, associate examiner. 

F OUR major objectives of science 
education were stated, delineated, 
and exemplified in the panel report; 
These four objectives are that students 
should come to: 

I. Know the fundamental facts and 
principles of science. 

II. Possess the abilities and skills 
needed to engage in the processes 
of science. 

III. Understand the investigative nat- 
ure of science. 

IV. Have attitudes about and appreci- 
ations of scientists, science, and 
the consequences of science that 
stem from adequate understanding. 
The delineation of I. consisted of a 
list of 26 topics in connection with 
which students of science can be ex- 
pected to know fundamental facts and 
principles. Ten abilities and skills were 
outlined as necessary to engage in the 
^/'processes of science, namely: A. Abil- 
ity to identify and define a scientific 
problem; B. Ability to suggest or rec- 
ognize a scientific hypothesis; C. Ability 
to propose or select validating proced- 
ures both logical and empirical; D. 
Ability to obtain requisite data; E. 
Ability to interpret data; F. Ability to 
check the logical consistency of hy- 
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potheses with relevant laws, facts, ob- 
servations, or experiments; G. Ability 
to reason quantitatively and symboli- 
cally; H. Ability to distinguish among 
fact, hypothesis, and opinion, the rele- 
vant from the irrelevant, and the model 
from the observations the model was 
devised to describe; I. Ability to read 
scientific materials critically; and J. 
Ability to employ scientific laws and 
principles in familiar or unfamiliar 
situations. 

Understanding the investigative nat- 
ure of science was analyzed as : 

A. Scientific knowledge develops from 
observations and experiments and 
the interpretation of the observa- 
tions and the experimental results. 
Such observations and experiments 
are subject to critical examination 
and to repetition. 

B. Observations are generalized in 
laws. 

C. Laws are generalized in terms of 
theories. 

D. Some questions are amenable to 
scientific inquiry, and others are 
not. 

E. Measurement is an important fea- 
ture of science because the formu- 
lation as well as the establishment 
of laws is facilitated through the 
development of quantitative dis- 
tinctions. Measurements are in- 
herently only approximate and are 
progressively inclusive and incisive. 

F. Science is not, and will probably 
never be, a finished enterprise. 

The attitudes and appreciations to be 
expected of one educated in science 
were also listed: 

A. Recognize the distinction between 
science and its applications. 

B. Have accurate attitudes about sci- 
entists. 

C. Understand the relationship be- 
tween science and misconceptions 
or superstitions. 

D. Be ready and willing knowingly to 
apply and utilize basic scientific 
principles and approaches, where 
appropriate in everyday living. 

E. Be independently curious about 
and participate in scientific activi- 
ties. 

The prototype exercises that were 



developed to define these objectives 
more concretely included different ones 
for the several age groups. For ex- 
ample, under Knowing fundamental 
facts and principles, nine-year-olds 
could be expected to know that green 
plants have the ability to produce food 
that animals use. Under Possessing the 
abilities and skills, a thirteen-year-old, 
when shown a film-clip of a walk in 
the woods, should be able to identify 
three phenomena that he could profit- 
ably investigate through a series of 
observations* measurements, and/or 
experiments. Under Understanding the 
investigative nature of science, seven- 
teen-year-olds should be able to answer 
this: 

“All of the following questions are 
amenable to scientific inquiry except: 

(A) How does the motion of a body 
change under the action of a 
force? 

(B) What metal alloy can be used to 
make the strongest nails? 

(C) How can the most efficient heat 
engine be made? 

(D) What proportion of the federal 
budget should be spent for space 
exploration? 

(E) What colors of paint reflect the 
most light?” 

Under Attitudes and appreciations, 
adults could be asked: “How often 
have you talked about current events 
in science with your friends? Which 
science magazines do you read? (For 
each one mentioned) How frequently 
do you read it?” 

The above are only a few illustra- 
tions. The panel report outlines proto- 
type exercises for each sub-objective 
and for each of the four age levels. This 
list of objectives, along with the lists 
from other fields and together with the 
prototype exercises which help to de- 
fine them, have been reviewed by a 
series of panels of pubdc-spirited citi- 
zens living in various parts of the coun- 
try, in cities, towns, and villages. Each 
panel spent two days reviewing the 
material and making a judgment about 
each objective in terms of the ques- 
tions: “Is this something important for 
people to learn today? Is it something 
I would like to have my children learn?” 
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This process resulted in very little revi- 
sion of the original listing of objectives, 
but it should help to eliminate the pos- 
sible criticism of the assessment as in- 
cluding unimportant matters or tech- 
nical trivia. 

A FTER the lists of objectives and 
i prototype exercises were devel- 
oped and reviewed, the contractors 
were asked to proceed with the con- 
struction of a large and representative 
sample of exercises for each objective 
and for each of the four age groups. 
This task was begun early in March 
1966 and should be completed before 
the end of the summer. The exercises 
from the four contractors will then be 
assembled in convenient groupings for 
tryouts during the fall and winter of 
1966-67. 

A national assessment to identify 
kinds of progress being made in educa- 
tion and problems and difficulties aris- 
ing will not be very meaningful unless 
separate measures are obtained for 
populations within the total, country 
which vary among themselves and thus 
present different degrees and kinds of 
progress and different problems to be 
solved. The particular populations that 
need to be treated separately may 
change over the years ahead but for 
some time, age, sex, socioeconomic 
status, geographic location, and rural- 
urban-suburban differences will prob- 
ably be significant. Hence, the present 
plan is to assess a probability sample 
for each of 192 populations defined by 
the following subdivisions: boys and 
girls, four geographic regions, four age 
groups (nine, thirteen, seventeen, and 
adult), three divisions by urban, sub- 
urban, rural classifications, and two 
socioeconomic levels. 

The fact that populations are to be 
assessed and not individuals makes it 
possible to extend the sampling of ex- 
ercises far beyond that of an individual 
test in which each person takes it all. 
It may be that a comprehensive assess- 
ment would require so many exercises 
that if it were to be taken by one per- 
son he would need 10 hours or more 
to complete them. With a population 
sample, 20 persons, each spending 30 



minutes, would together take all the 
exercises. In this case, a population of 
10,000 persons would furnish a sam- 
ple of 500 for each of the assessment 
exercises, and no one would have given 
more than 30 minutes of his time. As- 
suming that an assessment would be 
made every 3 to 5 years in order to 
ascertain the kinds of progress taking 
place, it is very unlikely that many of 
those individuals who participated in 
the earlier assessments would be in- 
volved in any of the subsequent ones. 
Hence, from the point of view of the 
child or adult, no serious demand 
would be made on his time. Further- 
more, it is unlikely that the children 
taking exercises in later years would be 
drawn from the same classrooms as 
the earlier ones. Therefore, the de- 
mands made upon a teacher in releas- 
ing a child for haJf-an-hour will be 
minimal. The assessment, though 
costly, should be feasible and involve 
little or no inconvenience to individuals 
or to schools. 

Since the assessment does not require 
that all participants be in classes, the 
exercises to be used are not limited to 
the usual test items. Interviews and 
observational procedures are also to 
be employed to furnish information 
about interests, habits, and practices 
that have been learned. Because school 
objectives commonly include these 
areas, it is necessary to see that some 
assessment is made of the levels of 
attainment. 

The assessment exercises will differ 
from current achievement tests in an- 
other important respect. An achieve- 
ment test seeks to measure individual 
differences among pupils taking the 
test. Hence, the items of the test are 
concentrated on those which differenti- 
ate among the children. Exercises 
which all or nearly all can do, as well 
as those which only a very few can do, 
are eliminated because these do not 
give much discrimination. But, for the 
purposes of assessing the progress of 
education, we need to know what all 
or almost all of the children are learn- 
ing and what the most advanced are 
learning, as well as what is being 
learned by the middle or “average” 



childreq/ To devise exercises of this 
sort will be a new venture for test con- 
structors. They are required to de- 
velop exercises at each age level in 
which approximately one-third repre- 
sent achievements characteristic of 
most of those at that age level, one- 
third represent achievement character- 
istic of about half of those at that age 
level, and one-third represent the 
achievements characteristic of the most 
advanced, that is, the top 10 per- 
cent, of that age level. 

T O summarize the educational at- 
tainments of these several popula- 
tions it is not necessary to compute test 
scores. Instead, the following sorts of 
things would be reported: 

For the sample of thirteen-year-old boys 
of higher socioecenomic status from large 
cities of the Northeast region it was found 
that: 

91 percent knew two-thirds of the following 
important ingredients in a person’s diet . . . 
52 percent could plan an appropriate experi- 
ment for testing hypotheses like the fol- 
lowing . . . 

68 percent answered this question correctly: 
“Which of the following areas of scientific 
inquiry has been completely investigated and 
is thoroughly understood? 

A. Electricity 

B. Weather 

C. Gravity 

D. Heredity 

E. None of the above” 

57 percent indicated that they did not believe 
in any of the following superstitions. . . . 

This mode of reporting avoids com- 
parisons among individuals, schools, 
or school systems, and the meaning is 
more clearly understood by the layman 
than standard scores or other indices 
based on relative performance. 

It is anticipated that the assessment 
would be in charge of a commission of 
highly respected citizens. They and the 
Commission staff would prepare re- 
ports of the findings of the assessment? 
rauch-asove-now obtain-reports-of-the - 
findings-every IQ^ears-of the decennial 
census. These reports would be avail- 
able to all people interested in educa- 
tion, providing them in this way with 
significant and helpful information on 
what has been learned by each of the 
192 populations. .In subsequent years, 
the progress made by each of these 
populations since the preceding assess- 
ment would also be reported. # # 
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